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Abstract 

This paper addresses network code design for robust transmission of sources over an orthogonal 
two-hop wireless network with a broadcasting relay. The network consists of multiple sources and 
destinations in which each destination, benefiting the relay signal, intends to decode a subset of the 
sources. Two special instances of this network are orthogonal broadcast relay channel and the or- 
thogonal multiple access relay channel. The focus is on complexity constrained scenarios, e.g., for 
wireless sensor networks, where channel coding is practically imperfect. Taking a source-channel and 
network coding approach, we design the network code (mapping) at the relay such that the average 
reconstruction distortion at the destinations is minimized. To this end, by decomposing the distortion 
into its components, an efficient design algorithm is proposed. The resulting network code is nonlinear 
and substantially outperforms the best performing linear network code. A motivating formulation of 
a family of structured nonlinear network codes is also presented. Numerical results and comparison 
with linear network coding at the relay and the corresponding distortion-power bound demonstrate the 
effectiveness of the proposed schemes and a promising research direction. 
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I. Introduction 

A wireless sensor network consists of a large number of small, low cost and power constrained 
sensor nodes, which are spatially distributed and communicate through wireless channels. The 
nodes power limitation and the wireless propagation loss indicate that these nodes can commu- 
nicate over short distances. Communications over longer ranges may be facilitated with multiple 
hops. In other words, the source signal is relayed by one or more nodes in the network and 
forwarded to the receiving nodes. We refer to a two-hop network with a single broadcasting relay 
as the TN-BR. In a TN-BR, utilizing the relay signal, each destination node intends to decode 
the signals transmitted by a certain subset of the sources. Two particular TN-BR scenarios are 
broadcast relay channel (BRC) (Fig.[lja)) and multiple access relay channel (MARC) (Fig.[TJb)). 
In such networks, a dedicated relay assists reliable transmission by broadcasting an appropriate 
signal, based on a certain relaying scheme, to the destination(s) [[Il[l2l- 

In this paper, we consider a special case of the TN-BR with source nodes in which 
every source communicates with its intended destination(s) in a distinct orthogonal channel 
without interference. The relay is half duplex and listens to whatever the sources transmit; it 
then broadcasts to all the destinations in another orthogonal channel. We refer to such a network, 
with A^ + 1 orthogonal channels, as orthogonal TN-BR (OTN-BR). In this orthogonal setting, a 
BRC may be viewed as one with several source-destination pairs with corresponding orthogonal 
channels and a dedicated broadcasting relay, referred to as the orthogonal multi-user channel 
with broadcasting relay (OMC-BR) [|3-[l5l. This paper presents network code design at the 
relay for an OTN-BR with constrained resources and considers orthogonal MARC (OMARC) 
and OMC-BR as special cases. 

Capacity achieving approaches in wireless channels with relay require substantial memory at 
the relay to accommodate inter-block encoding and large block sizes H-llHl. Though, in the 
context of complexity constrained wireless sensor networks simple channel codes and optimized 
memory less mappings at the relay ll9]l- [fT2ll are of practical interest. In [9] and [flQl, for a 
single source communicating a continuous signal to a single destination over a relay channel or 
through multi-hop relays, memoryless relay mappings maximizing the SNR at the destination are 
presented. In IEEE 802.15.4 fil3i . the widely popular standard for wireless sensor networks, in 
fact, no channel coding is considered. This implies that links are not practically error free and the 
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errors are to be tackled at higher layers of protocol stack. One option is to devise an automatic 
repeat request protocol at the link layer [fT4l . In this work, we take a joint source-channel-network 
coding approach to deal with the error at the presentation and network layers. 

In a general network, network coding at the relay nodes may be considered for improved 
communications performance. In [ITSll . it is shown that multicast capacity (maximum multicast 
rate) in an error free network can be achieved by network coding. In this setting, the intermediate 
nodes are allowed to decode and re-encode their incoming information. In [fT6ll , it is demonstrated 
that linear network coding with finite alphabet size can achieve the multicast capacity for 
communications over a network with error-free links. This corresponds to a separate design 
of network and channel coding, in the sense that perfect point to point channel codes render the 
hnks error- free from a network layer perspective. In [17], it is shown that source-network coding 
separation or channel-network coding separation is not optimal for non-multicast networks. In 
IfTSlI , it is shown that source and network coding separation is not optimal even for general 
multicast networks and that it is optimal only for networks with two sources and two receivers. 
Effective joint network-channel codes are presented for robust multicast over networks with 
noisy links in, e.g., M-[|25l. 

In this paper, taking a joint source-channel-network coding approach for the OTN-BR, we 
present optimized network coding schemes at the relay for efficient reconstruction of the source 
signals at the destinations. In particular, we focus on resource constrained wireless networks, 
e.g., a wireless sensor network, where it is assumed that the mapping at the relay is memoryless 
and the channel coding is practically imperfect. First, a decoding scheme is presented for the 
minimum mean squared error (MMSE) reconstruction of signals transmitted from sources over 
the noisy channels of an OTN-BR at the destinations. As we shall demonstrate, in such a setting, 
the average reconstruction distortion at the OTN-BR destinations is decomposed into two parts 
referred to as the source distortion and the network distortion. The former is due to source coding 
and the latter primarily corresponds to the network, i.e., its channels, decoding and encoding 
(mapping) at the relay and decoding at the destinations. The network distortion is also influenced 
by the source coder output statistics. The objective is then to design a proper network code at 
the relay that minimizes the network distortion. This in turn lends itself to an efficient design 
scheme based on simulated annealing (SA), which results in a nonlinear network code at the 
relay. Taking insight of the resulting mappings, we next consider a motivating formulation of a 
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family of structured nonlinear network codes with substantially reduced design complexity. As 
a benchmark for comparisons, we also present performance cut-set bounds for OTN-BR. 

Numerical results are provided demonstrating the superior performance of the proposed codes 
when compared to linear network coding. The outcomes are particularly inspiring as they 
demonstrate (i) the insufficiency of linear network coding in such wireless networks, (ii) a 
constructive approach to design nonlinear network codes and (iii) the effectiveness of the pro- 
posed joint source-channel-network coding schemes in complexity constrained wireless networks 
in comparison to the performance bounds. 

The rest of this article is organized as follows. Following the preliminaries and the description 
of system model in Section |n| Section III presents a MMSE decoder for OTN-BR. Next, in 



Section |IV] the distortion at the OTN-BR destinations is analyzed. In Section |V| a method to 
design an optimized network code at the relay is presented and then a family of structured 



nonlinear network codes for the OTN-BR is suggested. Sections VI and VII present the separate 



source and channel-network coding bounds and the performance evaluations and comparisons. 



respectively. This article is concluded in Section VIII 



II. Preliminaries 

A. Notation 

The following notations are used in this paper. Capital letters, e.g., /, represent random 
variables and small letters, e.g., i, represent the realizations of random variables. We replace 
the probability P(I = i) by P{I) for simplicity. The vectors are shown bold faced, e.g., /. The 
sets are identified by scripts, e.g., A. For the set A C B, denotes the complement of A in 

B. We denote the sets of random variables {Ut ■ k E A}, {Urn,k ■ k G A} and {Uk,rri '■ k E A} 
by Ua, Um,A and UA,m, respectively. 



B. OTN-BR 

In an OTN-BR, there are sources, M destinations and one relay. The sets 5 = {1, A^} 
and V = {1,...,M}, respectively indicate the set of sources and destinations. The transmitted 
signal of source s G 5 is to be decoded at each of the nodes in Vg. The subset of the sources 
that are to be decoded at the destination d E V are denoted by Sd- 
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In Section |I} we presented OMARC and OMC-BR as particular instances of OTN-BR. In 
addition to these two networks, we also consider another instance of OTN-BR with two sources 
and three destinations, denoted by OTN-BR-(2,3) (Fig. [T]^c)). While the developments in subse- 
quent sections pertains to arbitrary OTN-BRs, we exemplify and assess the performance of the 
proposed code construction and decoding algorithms based on these three OTN-BR networks. 
In an OTN-BR-(2,3), the destination d, d G {1,2} is to decode its corresponding source s = d, 
while the destination c? = 3 is to decode the signals transmitted from both sources. Thus, in 
this network, M = 3, N = 2, Sd=i = {1}, Sd=2 = {2}, Sd=3 = {1,2}, Vs=i = {1,3} and 
V,=2 = {2, 3}. Furthermore, for an OMC-BR, M = N, Sd = {d} : d E V and Vs = {s} : s E S, 
while for an OMARC, M = 1, Sd=i = S and = {1} : s E S. 

C. System Settings 

At the source node s, s E S the source signal Xg is scalar quantized with rate Rs, mapped 
to a codeword (index) and transmitted to the destination nodes Vs. The number of quantization 
partitions (Voronoi regions) for source node s is equal to Lg = 2^= and we refer to the partition 
Is of this quantizer as Vj^, where Is E Ig, = {1, . . . , Ls}. If the signal Xs belongs to Vj^, the 
corresponding Rs bit index Ig is transmitted over a memoryless noisy channel orthogonal to those 
of other users. This is accomplished, e.g., based on a time multiplexing scheme [|26l and BPSK 
modulation. In this case, when the source node s, s E S transmits, the relay and destination 
nodes are in the receive mode; subsequently, the relay transmits and all the destination nodes are 
in the receive mode. Thus, the transmitted index Ig, s E S is received over noisy channels at the 
relay and also at the corresponding destinations Vg as vectors F,. and Yjy^^s = {Yd,s : d E Vs} 
each with Rs components, respectively. 

As elaborated in Section |I| focusing on a complexity constrained solution; we assume mem- 
oryless mappings at the relay. Therefore, the relay decodes the received vectors F.,. s, s E S 
to the indexes Is, s E S based on a maximum a posteriori (MAP) symbol decoding rule, i.e.. 
Is = argmax P {Is\Yr^s)^ The relay then broadcasts the index = f{Is) with R^ bits to all 
destinations, where E X^, X^ = {1, . . . , = 2^"^}. Note that f{Is) denotes an arbitrary 
(not necessarily linear) network coding function at the relay. The transmitted relay index Ir is 

'Note that = 2^' and the quantizer bit-rate Rs is hmited, hence the decoding complexity is fairly small. 
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received at the destination node d, d G V as F^ ,. with Rr components. Thus, the rate of the 
network code is defined as Rnc = -Rr/X^se-s 

Each of the communication channels is assumed memoryless, without intersymbol interference 
and described by the transition probabilities P{Yj^k\Ik), where {k,j) G Q and 

g = {ik,j) : k e S,j e Vk} U {ik,j) : k = r,j E V} U {(A;, j) : k G S,j = r}. (1) 

This may be motivated by the use of an interleaver or a scrambler at the physical layer. In this 
paper, we aim at designing the network code or mapping at the relay such that the average 
reconstruction distortion at the destinations is minimized. 

D. Definitions 

The developments in subsequent sections in general concern OTN-BR in arbitrary settings. 
However, the following particular scenarios are also considered in parts. 

Definition 1: The "noiseless relay channels" corresponds to the scenario, where in an OTN- 
BR the channels from sources to the relay and also from the relay to the destinations are (almost) 
noiseless (high SNR). In this case, the source-destination channels can be noisy. 

Definition 2: The "noiseless relay channels and very noisy source-destination channels" corre- 
sponds to the scenario, where in an OTN-BR the source-destination channels are very noisy and 
the channels from sources to the relay and also from the relay to the destinations are noiseless. 
When a channel is very noisy (low-end of SNR range), the output of the channel is (almost) 
independent of its input. 

III. MMSE Decoding at OTN-BR Destinations 

At each destination, the objective is to produce the minimum mean squared error estimation 
of the signals transmitted from its corresponding sources exploiting their dependencies with the 
signal received from the relay. According to the described system model, we take a joint source- 
channel- network coding approach that includes the effect of quantization as source coding. In 
line with the joint source-channel coding literature, the mean squared error (MSB) is a desired 
performance (distortion) criterion [|27ll . 

Proposition 1: In an OTN-BR destination node d E V, given Y^^s^ and F^r, respectively the 
received signals from sources s E Sd and relay, the optimum MMSE reconstruction (estimation) 
of the transmitted source signal s is given by: 
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Xs,d — gs{Yd,Sd, Yd,r) — E [Xs\Yd,Sd, Yd^r] 

where 

K = 5^5^P(F,,5j/5jP(F,,,|/,)P(/,|/5jP(/5j (3) 

Ir 

is a factor which normalizes the sum of probabilities to one. 

Proof: In ([2]), C/^ = s G Sd, describes the codebook at the destination d 

corresponding to the source s G Sd- We have P{Yd,sJ\Isd) = H P{Yd,s\^s), and the terms 

seSd 

P{Yd^s\Is), s E Sd and P{Yd^r\Ir) represent the channel transition probability for the channels 
from source s, and relay to destination d, respectively. The term P{Ir\Is,) in (|2]) and ([3]) is given 
by 

pmisj = 5^p(/.i/5)p(4i^5j n ^(^^O' 

is je-s^ 
in which Is^ = {1^ : s G Sd} and Ig is the decoded index (symbol) at the relay corresponding to 
the index emitted from the source s. The term P(Ir\Is) G {0, 1} corresponds to the mapping 
or the network code function = f{Is) at the relay. In (|4]), we have P(/s) = J2Pi^s\h)Pih), 

Is 

where P{Is\Is), s E S indicates the transition probability of the equivalent discrete source-relay 
channel. The proof is completed in Appendix |Aj ■ 

The value of Cj^ and P(/s), s G 5 are acquired from the source coder and stored at every 
destination d, d E Vg. As the quantizers bit-rates are relatively small, this incurs a limited 
complexity. Given that the channel transition probabilities P{Yd^Sd\^Sd) and P(Yd^r\Ir), and the 
network code f{Is) are available at the destination d, the RHS of (2) can be effectively computed. 

The following two corollaries present Proposition [T] for OTN-BR in scenarios described by 
Definitions 1 and 2. These may be utilized to invoke simplified network code design procedures, 
as elaborated in Sections |V] and IVIIi 

Corollary 1: In an OTN-BR with "noiseless relay channels", given Yd^Sa at the desti- 

nation d E V, the MMSE estimation of the transmitted signal from the source s E Sd is, given 
by 

Xs4 = 9l{Yd,s,, Ir) = E [Xg\Yd,s,, Ir] = ^ Yl ^ PiYd,sJIsjPiIs), (5) 

IsJ{Is) = Ir 
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in which, K is a factor which normahzes the sum of probabilities to one. 

Corollary 2: In an OTN-BR with "noiseless relay channels and very noisy source-destination 
channels", given at the destination d E V, the MMSE estimation of the transmitted source 
signal s e Sd is given by 

Xs,d = Xs = g'M=E[X,\Ir] = ^ J2 E[Xs\Is]P{Is), (6) 

in which, K is a factor which normalizes the sum of probabilities to one. 

Using Proposition [Tj obtaining the results in Corollaries [T] and [2] is straightforward. 

IV. Distortion at Destinations 

In this section, we investigate the average reconstruction distortion at the destinations in an 
OTN-BR. Specifically, we focus on how the distortion may be decomposed into its components 
to facilitate network code design at the relay. The average reconstruction distortion (MSE) at 
the destinations can be expressed as follows 

M 2 



d=l 

M 



(7) 



d=l 

X P misj P {Yd,s,\Is,) P {YdAQ P (X^J dYd,sA^dAXs,, 

in which Xs^ = gs {Yd,Sd^ Yd^r), s E S is given in Proposition [Tj \Sd\ is the number of elements 
in Sd, Vig^ = {Vj^ : k E Sd} denotes (Voronoi regions) quantization partitions Ik of sources 
k E Sd and P (Ir\Isa) given in Q represents the effect of source-relay channels, and decoding 
and network coding at the relay. 

Proposition 2: The average distortion at the OTN-BR is equal to the sum of two terms as 

follows D = Dsources + P>network in wMch 

I ^' r 

D sources j ^ 

d=l 

and 



A/ 
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I ^ f f 2 

Dnetwork = -J^ ^ ^^^d) / / l^h " ds {Yd,Sd, 

f^\Sa\ d=i sesa ir is^ i-d.Srfi-d,. (9) 

d=l 

X P mis,) P {Yd,sJIs,) P [YdAlr) ^Yd,sA^d,r, 

where Qs {Yd,Sci-, Yd,r) and P{Ir\Isi) are given in Proposition [T] and (Q, respectively. 

Proof: Replacing \Xs - gs iYd,Sd, Yd,r) \ by \Xs - Cj^ + - Qs Yd,r) \ in 0, we can 

write D as the sum of three terms, i.e., D = Dgources + Dq + Dnetwork, in which 

1 



' sources 



■IT^EEEi: / / / \X.-C,fP(MIsJ 

^\Sd\'^=^'^^d Ir Vl Y,,s,Ya,r (10) 

d=l 

X P {Yd,Sd\ISd) P iYd,r\Ir) P {Xs,) dY d^sAY dA^s^, 



M 



and 



^0 =^i7^E E E E / / / 2(^^ - C/J (C/. - 9s {Yd,s,, Yd,r)) 

Y^\Sj\d=ls&Sa Ir Is, y^^ Fd,5, I'd,. (11) 
d=l 

X P misj P iYd,sJIs,) P iYd,r\Ir) P dYd,sAYd,rdXs, 

Dnetwork =-^^ EE EE j j j \^ ~ 9s (Yd^Sa, Yd,r)f 

X]|'5d|'^=l*6'5d vi Ya,s,Ya,, (12) 

d=l 

X P mis,) P {Yd,s,\Is,) P {Yd,r\Ir) P (Xs,) dYd,S,dYd,rdXs,. 



Noting that the sources are independent and ^ J P{Xs)dXs = 1, D sources in ( fTO] ) is simplified 

Is Vl, 

to ([8]). Considering / {Xs - CiJ P{Xs)dXs = 0, it is straightforward to see that Dq = 0. 

Vis 

Finally, noting that / P{Xs,)dXs, = P{Isa), we obtain Dnetwork as in U 

Sd 

As expected, the term Dgources only depends on the distortion due to source coding (quan- 
tization) and is independent of the network code at the relay or of the channel. On the other 
hand, only the term Dnetwork depends on the channels and the network code at the relay. Hence, 
we design the network code such that Dnetwork is minimized. As evident, Dnetwork also depends 
on source coder output statistics and MMSE decoding of the source signals at destinations. 
Therefore, the design takes a joint source-channel-network coding approach. 

The following two corollaries present Proposition [2] for OTN-BR in scenarios described by 
Definitions 1 and 2. These may be utilized to invoke simplified network code design procedures, 
as elaborated in Sections |V] and IVIIi 



Corollary 3: In an OTN-BR with "noiseless relay channels", Dnetwork is given by: 

M 



Dnetwork = ^^Y.11Y.P^^S) I \C - g] [Y ,,s,Jr = f [I s)f P [Y ,^s,\Is,) a^s,, 
d=l 

(13) 

where gl{Yd,Sd, h), s G 5 is given in Corollary [T] 

Corollary 4: In an OTN-BR with "noiseless relay channels and very noisy source-destination 
channels", Dnetwork is given by: 

1 2 
Dnetwork = -Jj- X] X] X] (-^-s) 1^^^ ~ 9s i^r = f{h))\ , (-^4^ 

J^\Sd\ ^^=1 "^^d Is 

d=l 

where gl{Ir), s G S is given in Corollary [I] 

V. Code Design at the Relay: Implementation and Complexity Considerations 



As described in Section II-C, the relay MAP decodes the received signals Yr^g, s G iS to 
the indexes = {/g : s G S} and then broadcasts the network coded index Ir = f{Is) to the 
destinations. At the relay, the network code f{Is) is designed such that the average reconstructed 
signal distortion at the destinations is minimized. Since only Dnetwork depends on the network 



code at the relay, the goal is to minimize Dnetwork as defined in ([9]), ( [13] ) or ( |T4| ). To this end, 
an exhaustive search to identify the optimal code at the relay requires 2^^ x . . . x 2^^^ x 2^*^ 
tests of all combinations. Thus in the following, targeting an efficient solution, we first devise 
an approach based on simulated annealing and then inspired by the results attempt to formulate 
a structured network code. 



A. Network Code Design at the Relay: An Approach based on Simulated Annealing 

Simulated annealing is an iterative algorithm that belongs to the class of randomized algorithms 
for solving combinatorial optimization problems. Given the current state (here network code), 
the next candidate state in SA is created with certain level of randomness, based on a so-called 
perturbation scheme. To avoid sticking in local minima, a candidate state with higher cost may 
also be probabilistically selected as the new state [[28l. The SA converges in probability to a 
global minimum if a proper perturbation scheme and a suitably slow cooling schedule are used 
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||28ll . The two govern the possible improvements to the code in each iteration and the number of 
iterations, respectively. In particular, if the initial temperature Tq is sufficiently large, a cooling 
schedule described by = c/log(A; + 1), guarantees such a convergence [|28l . where c is a 
positive constant and is the temperature after k temperature drops. The SA is previously used 
for index assignment in robust source coding [12811 and also for designing source and channel 
codes in [|29l . An alternative binary switching scheme is used in [|30ll for source-optimized 
channel coding in point-to-point digital transmission. 

We consider a 2^^ x . . . x 2^^ lookup-table (codebook) at the relay in which each element 
indicates the mapping of codewords (indexes) ^/i, /2, • • • , In^ received from the sources to an 
index at the output of the relay. The proposed SA-based algorithm to design this code at the 
relay is described below. 

1) Set an initial appropriate high temperature T = Tq. 

2) If this is the first iteration, initialize the lookup-table randomly. Otherwise, generate a test 
code by perturbing the current one. Perturbation is accomplished by changing the value of 
a certain table element to that of one random element among its adjacent neighbors. The 
element for perturbation is chosen in order, e.g., row-wise, in subsequent iterations. 

3) Calculate Dnetwork using Proposition [2] (resp. Corollary |3] or |4]). Compute the change in 
Dnetwork in comparison to that in previous iteration (AD). 

4) If AD < 0, then the perturbed code is adopted. Otherwise, it is only chosen with 
probability exp(— ^). 

5) Iterate by going to step 2, until the code is updated for a sufficient number of times or a 
maximum number of iterations is reached. 

6) Lower the temperature. If the temperature is below a specified value or the relative change 
in Dnetwork IS insignificant, stop; otherwise go to step 2. The cooling schedule adopted 
here is = aT^^i, < « < 1, as in ||28lll29l . which allows for a faster design process. 

When the algorithm terminates, the code design process is completed and the resulting code 
may be used for operations. Thus, the main complexity remains at the design procedure for the 
network code at the relay. 

Remark 1: To design nonlinear network codes as described, particular assumptions on channel 
conditions may be made to simplify the design procedure. This is incorporated in step 3 of 
the algorithm, where Corollary [3] or |4] may be utilized instead of Proposition |2j This provides 
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performance versus design complexity trade-offs, as assessed in various channel conditions in 
Section |VlIl 

Remark 2: Although, the proposed network code design algorithm is devised for a general 
OTN-BR, where soft outputs may also be available at the destinations, to speed up the design 
procedure, one could consider equivalent hard-decided received signals. Naturally, in this case 



the integrals in ([9]), ( [T3| ) or ( [14] ) are replaced with summations. 

Example 1: As an example of the network code design, we here consider an OTN-BR with 
two sources, when the source signals are Gaussian and Ri = R2 = R. For R^ = R = 3, the 
network code is an 8 x 8 lookup-table, where one of 8 codewords (indexed to 7) is assigned to 
each of its elements. One such code obtained via the proposed SA-based scheme is presented in 
Fig. ^a). This code is clearly nonlinear as for example, for [Ji, I2] = [1, 1] and [Ji, I2] = [2, 4], 
/(/i,/2) = 6 and /(A, 12) = 0, while /(/i © h, h © h) = 0. Of course, the network code 
/ is linear if and only if WIj, fj e Ij, < j < N - 1, /(/i, . . . , /^) © f{h, ...,In) = 
/(/i © /'i, . . . , /at © /at), in which © denotes summation in GF{2^''). 

B. Structured Network Code 

As stated, our experiments demonstrate that the network codes obtained for the relay based on 



the proposed approach in Section V-A are nonlinear. Motivated by these results, here we attempt 
to formulate a structured nonlinear network code. This provides a closed form expression of the 
network code at relay, and as we shall demonstrate substantially reduces the design complexity. 
It is noteworthy that there is only very limited reports in the literature on the theory of nonlinear 
(channel) codes, e.g., [|3T1l . 

Consider the proposed network code in Fig. 2(a) designed for an OTN-BR with two sources 
and Rr = R = 3, Rnc = |- As evident, there are regions or clusters with the same codeword 
which partition the codebook. Our research indicate that the performance of the code is primarily 
affected by the partitioning and not by the exact codeword (index) assigned to each partition. 
Based on these observations, in Fig. [2]^b) for the two source OTN-BR, a structured network 
code is proposed based on a partitioning of the network codebook (lookup-table at the relay). 
As a possible extension to the case of OTN-BR with N sources with the same network coding 
rate, we consider the setting where the mapping of the first dimension and any other dimension 
follows the same partitioning as that in Fig. ^h). The resulting family of structured network 
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codes /(/i, . . . , In) may be formulated as follows. 



N 



< Ji < 2 , ks^i = Is o 2^=-i : ks^i G {0, 1} 



2 < A < - 2, A;i 



/i-2 
4 



^k2,...,kf. 



ki e {0,...,2«i-2-l} , A;,^i G {0,...,3}, 

2^1 - 2 < Ji < 2^S = o 2«=-i : A;,^i G {0, 1} 

(15) 

if 0<is< 2^--^ 

. In ([15]), ak2,...,kN, 

1 otherwise. 

^fci,fc2,...,fciv' ^k2,...,kN ^ 2^"^ distinct indices. As the partitioning is now fixed according to 

( [T5| ), the design is now simplified to assigning the values of these indices, which may be handled 
by a SA-based algorithm with substantially smaller complexity. Our experiments (reported in part 



where, the operation o is defined as o 2 



Rs-l 



in Section VII) reveal the efficiency of the proposed code structure and only a small performance 



gap with the (unstructured) code produced by the presented algorithm in Section |V-A[ Noting the 
definition of network coding rate Rnc and utilizing ([15]) for Rs = R E S, we have Rnc = 

[log2 (4 X 2^-2 _^ - 4) X 4:^-^)]/NR, which as desired is nearly ^ for i? G {2, 3, 4} and 
iV < 5. 



VI. Separate Source Channel-Network Coding Bound 

In this section, we present performance bounds by combining the rate-distortion function due 
to source coding with the capacity upper-bound, due to the cut-set bound for wireless networks 
under consideration. The latter corresponds to joint channel-network coding. Therefore, we refer 
to the bounds thus derived as the separate source and channel-network coding bound, which is 
naturally obtained assuming large block lengths. 

In the following, we first present a cut-set upper bound on the achievable rates _Rc,s (bits per 
channel use - due to joint channel-network coding) in a Gaussian OTN-BR for communications 
between the source node s and the corresponding destination nodes. Vs. In a Gaussian OTN-BR, 
each link is modeled as an independent additive white Gaussian noise channel, where the noise 
is zero mean with variance a'^^,W{n,m) G G (refer to ([1]) for the definition of Q). Considering 
orthogonality of channels based on time multiplexing, the sources and the relay each transmit 
in a fraction of time T, i.e., AiT, . . . , AatT and (l — '^■^sjT, respectively. Suppose that the 
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sources and the relay are subject to the average power constraints Pi,. . . , P/v and P^. Thus, 
these nodes can transmit respectively with the average powers Pi = Pi/Ai, . . . ,Pn = Pn/^n 

and Pr = Pr/ (l — Xl^s) during their corresponding transmission periods. 

ses 

Proposition 3: For a Gaussian OTN-BR with N source and M destination nodes, the cut-set 
upper bound for the rates (Pc,i, • • • , Rc,s, • • • , Rc,n) is given by 

il / P- P- 1 1 / P- 




(16) 

Proof: We consider as a subset of sources, i.e., J-" C iS. A set of destinations, whose 
every member intends to decode all the sources in T is denoted by ^, ^ C Vjr. The cut Ci, 
is considered as that crossing only the outgoing channels from J^. On the other hand, the cut 
crossing the incoming channels to A and also including only the outgoing channels from the 
relay and is denoted by C,. Using max-flow min-cut theorem for the OTN-BR, we see that 
the maximum transmission sum-rate by the sources in is equal to the minimum of information 
flow across the cut Ci or the cuts corresponding to all possible subsets A. As evident in 



RHS of ( [T6| ), the first term corresponds to the cut Ci and the next term is related to the cuts 
C2. The complete proof of Propositions [3] is provided in Appendix |Bj ■ 
For a Gaussian source with variance and a source coding rate of Rg bits per source 
sample, the distortion-rate function D{Rs) is equal to cr^2~^^= (6]]. Considering separate source 
and channel-network coding, we have 

D{bRc,s) = crl2-^'"'^'% (17) 

where b denotes the number of channel uses per source sample. Thus, equation ( [TT] ) in conjunction 
with Proposition 3, presents a distortion-power function that serves as a performance bound in 
the sequel. 

We now consider Proposition |3] in a special case for a Gaussian OTN-BR-(2,3) in a symmetric 
network setting. A Gaussian OTN-BR is symmetric when cig^ = a'^^, a^ j. = cr'^r ^ '^rd = '^rd 
Ps = P, s eS, dev. We thus have P^ s = Vs G S. 
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Corollary 5: For a symmetric Gaussian OTN-BR-(2,3), the cut-set upper bound on the rates 
i?c,s = Re, s e 5 is given by 

1 f 2P P 
Rc < max min {\ - loEo ( 1 + 



1, P \ ^..l, Pr 



Following the approach described above, we can use ( [17] ) and obtain a distortion-power function 
for a symmetric Gaussian OTN-BR(2,3)- This provides a performance bound for comparisons 



in Section VII The bounds for OMARC and OMC-BR can be obtained in a similar way. 



VII. Performance Evaluation 

Consider a symmetric Gaussian OTN-BR with N source nodes producing independent Gaus- 
sian distributed signals with zero mean and unit variance, that are to be transmitted to the 
corresponding destinations. Each of these continuous signals is quantized using a 2^ level Lloyd- 
Max quantizer. The resulting quantization index is represented by a binary codeword. Each binary 
codeword is BPSK modulated and transmitted through a Gaussian channel. The network code 
at the relay is described by a 2^ x 2^ and 2^ x 2^ x 2^ lookup-table for = 2 and N = 3, 
respectively. To obtain network codes of rate (approximately) |, the relay transmission rate is 
selected as Rr = R for N = 2, and i?,. = 5 bits for = 3, = 3. 

At the relay, the received codewords from the sources are (symbol) MAP decoded and are 
combined using the proposed nonlinear network coding. Hence, we refer to them as decode and 
nonlinear network coding (DNNC) schemes and denote them by DNNC-Structured, DNNC-C3 
and DNNC-C4 indicating, as described in Section |V| the design based on the structured network 
code, or Corollaries |3] and |4] respectively. For comparison, we consider MAP decoding followed 
by classic linear network coding at the relay and refer to it as decode and linear network coding 
(DLNC). In this case, the binary codewords are represented and linearly combined in GF(2^'') 
with coefficients searched and selected to minimize the average distortion at the destinations. 
The code thus obtained is referred to as the best performing linear network code. 

For the performance evaluations of symmetric OTN-BRs in the following, the signal to noise 
ratio of the channel from any source to any of its corresponding destination nodes is denoted 
by SAi?^^***^" and SNR^d, during the design and operations, respectively. In the same direction. 
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SNRrd and SNR.^, respectively demonstrate the SNRs of the relay-destination channels and the 
source-relay channels during the operations. The average reconstruction signal SNR (RSNR), 
i.e., — V — z-^, where D is obtained from (fTl), is used as the performance criterion. 

A. Basic Comparisons 

Figs. [3]and|4]respectively, present the performance of an OMC-BR and an OMARC, with two 
sources, R = 3, Rnc = \ and SNR,^ = — 3dB. These figures and the results for the OTN-BR- 
(2,3) (not reported here) demonstrate that the proposed DNNC schemes substantially outperform 
the DLNC scheme. Specifically, a RSNR gain of about 4dB is achieved for all considered 
networks, when the source-relay and the relay-destination channels are of good quality. 

The DNNC-C4 (with the code in Fig. [2]; a)) is designed assuming very noisy source-destination 
channels and is simpler to design in comparison to DNNC-C3. Both DNNC-C3 and DNNC-C4, 
are designed assuming noiseless relay-destination channels. In such settings, however, as evident 
in Figs.|3]to[5| DNNC-C3 outperforms DNNC-C4. 

Examining the performance of the proposed DNNC-C3 scheme designed for SVR^^''*^" of -3dB 
and IdB in Figs. [3] to [5] demonstrates that, as expected, when the operating channel conditions are 
closer to the design setting, a higher performance is obtained. It is interesting to note, however, 
that the sensitivity of the performance to a mismatch of design and operations channel SNRs 
is insignificant. Our experiments over severely asymmetric networks indicate that the proposed 
network code in DNNC-C3 is designed to further assist the communication of source(s) with 
lower source-destination channel SNR. 

Also, comparing Figs. 4 and 5, it is evident that when the quality of the source-destination 
channels improves, as expected, the RSNR is enhanced and ultimately reaches that of a 3-bit 
Lloyd Max quantizer (~ 15dB). For noisy source-destination channels, the RSNR does not reach 
this limit even if the source-relay and the relay-destination channels are noiseless. This is due 
to the fact that the network coding at the relay is not a one-to-one mapping, and as expected, 
the corresponding relay signal is only meant to assist the source-destination transmission. In the 
current example, the relay receives i?i = 3 and R2 = 3 bit codewords from sources 1 and 2, 
respectively, while produces only one R,- = 3 bit codeword. 

In our studies, we have also examined another scheme (not reported here), which is referred 
to as estimate and forward nonlinear network coding (ENNC). In ENNC, the source signal 
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transmitted by each source is first estimated at the relay using an MMSE decoder. Subsequently, 
the estimated source signals at the relay are mapped to an output codeword using an optimized 
vector quantization scheme. According to our simulations, the ENNC provides only a limited 
gain over the DNNC at the cost of increased complexity. 

B. Ejfects of Rates of Network Coding and Quantization 

Fig.|6]presents the performance of OMC-BR network with = 3, for different network coding 
schemes and rates. The operation source-destination channel SNRs are set to SNR,^ = — 3dB. 
It is observed that, with R = 3, Rr = 5 and R^c = the proposed DNNC schemes achieve 
a gain of about 4dB in the RSNR compared to DLNC. Therefore, noting Figs. [3| |4] and[6[ it is 
evident that similar gains are achieved in the considered networks with N = 2 and = 3 for 
a given source-destination channel SNR, and rates of network coding and quantization. Fig. [6] 
also depicts the performance of the DLNC and the proposed DNNC schemes for Rr = R = 3, 
Rnc = |- expected, for a given quantization rate, the performance gain provided by the 
DNNC schemes is greater, when the network code rate R^c is larger. 

Figs. |7] and [8} respectively depict the resulting average distortion in an OMARC and an OTN- 
BR-(2,3) as a function of rate for R G {2, 3, 4}. It is observed that the proposed DNNC scheme 
provides a larger performance gain with respect to DLNC, when the quantization rate is greater. 

C. Performance of the Proposed Structured Nonlinear Network Code 

The performance of the proposed structured nonlinear network code is depicted in Figs. 
[3] to |6j This code is presented in Fig. [2]^b) for N = 2 and in ( [T5| ) for arbitrary A^. As 



evident, the structured network code performs closely similar to DNNC-C3 especially for high 
quality relay-destination channels. However, this performance is obtained with much smaller 
design complexity. Our experiments indicate that the nearly symmetric structure of the proposed 
structured network code leads to almost identical performance at different receivers over a 
symmetric network. For example, in a symmetric OMC-BR with = 3, SNR,^ = — 3dB 
and SNRri = 7dB, the average RSNR at the destinations 1, 2 and 3 is 8.42dB, 8.74dB and 
8.84dB, respectively. 

Considering symmetric network settings and the definition of the average distortion in Q, 
each of the proposed DNNC schemes in the three OTN-BR instances of interest provides the 
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same performance for given SNR,^ and SNR^^. This issue is evident in the simulation results 
depicted in Figs. [3]|5| |7] and [8j However, DLNC provides a better performance in OMARC in 
comparison to other considered networks as it is seen in Figs. |7]and[8] 

D. Distortion Power Trade-off 

Fig. |9] demonstrates the trade-off of average distortion and power of the sources (SNR,^) for an 
OTN-BR-(2,3). In this figure, the performance of the proposed DNNC with structured nonlinear 
network coding and DLNC are depicted together with the separate source and channel-network 
coding bound obtained from Corollary [5] for comparison. In Fig. [9} it is seen that the proposed 
DNNC with structured network code compared to DLNC reduces the gap to the bound by more 
than 50%. It is also evident in this figure that, (i) for high SNRsd both DNNC and DLNC result 
in identical residual distortion equal to that of a 3-bit Lloyd-Max quantizer, that is due to source 
coding; and (ii) an improved SNRrd enhances the performance gain provided by the proposed 
DNNC scheme. Our simulation results (not reported here) confirm similar observations for the 
OMARC and OMC-BR. 

VIII. Conclusions 

In this paper, network code design for the orthogonal two-hop network with broadcasting 
relay and constrained complexity was investigated. Taking a joint source-channel-network coding 
approach, the network code at the relay was designed to minimize the average distortion at the 
destinations. Decomposing the distortion into its components enabled the development of an 
effective network code design algorithm based on simulated annealing. The resulting network 
code is nonlinear and outperforms the best performing linear network codes. This indicates the 
insufficiency of linear network coding in complexity constrained wireless networks with a MMSE 
design criteria. The results also show that the sensitivity of the proposed nonlinear network code 
to a mismatch of design and operations channel SNRs is insignificant and the performance 
gain provided by the nonlinear code compared to the linear code is greater, when the network 
code rate is larger In comparison to the separate source and channel-network coding bound, the 
proposed nonlinear network coding at the relay in contrast to the linear code reduces the gap to 
the bound by more than 50%. This fact indicates the effectiveness of the proposed decode and 
nonlinear network coding schemes for the OTN-BR and a promising research direction. 
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Appendix A 
Proof of Proposition [I] 

At the destination d E V, based on the received signals F^^^ and the MMSE estimation 
of the transmitted signal Xg, s E Sd is given by: 

£s,d = 9s (FdA, Yd,r) = E [X,|F,,5„ YdA = Y^E [Xs\Is,] P (/^J^d^, Yd,r) • (19) 

Is, 

Since the sources are independent, we have E [Xs\Is^ = E [Xs\Is] and from ( fTO) ) we obtain 



9s Yd,r) = J2e [Xs\Is] P {Is,\Yd,s„ . (20) 

Using Bayes' theorem, we have 

ID r T w V \ — ^ (Yd,Sd^Yd,r\Isd) P{-^Sd) /^oix 

^[-lSd\j:d,Sd,J'd,r)- ^-7^ , (^i) 

r^{Id,Sa^^d,r) 

where 

P (F,,5„ YdM = P iYd,sM P (YdAls,) . (22) 



Thus, using pT] ) and ( [22| ), equation pO| ) is rewritten as 



[X,\Q P {Yd,sMs,) P {YdAh,) P{Is,) 

9s {Yd,Sa, Yd,r) = 57T^ 7^^^ , (23) 

{id,Sa, ^d,r) 

where 

P {YdM = {Yd,r\Ir) P {Ir\IsJ • (24) 

Ir 



Finally, using ( [23] ) and ^2A\ , we can obtain ([2]). Based on ([22]), the term K = P {Yd^SdJ Yd,r) is 



given by Q as a factor normalizing the sum of probabilities to one. 

Appendix B 
Proof of Proposition [3] 

Consider = U V^, Sa = U 5^ and F^^ = {F^, : d G ^, s G J", (s, d) E Q}, \/F d S 

seT deA 

and C Vjr, where Q is defined in In view of the max-flow min-cut theorem [|6l for the 
OTN-BR, an outer bound for the capacity region is the set of rate vectors {Rc,i,Rc,2, ■ ■ ■ Rc,n) 
satisfying 

Yvjr,T, Yr^J^\Xjrc,Xr, Q) , 
^6-^ (25) 

/ (X^, X,; F^,„ F^,^|X^c, Q):\/Ae V^, 5^0^ = ^} 
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over all distributions P{Q) (jj^^^ P{X,\Q)^ P {Xr\Xs,Q) with \Q\ < N + 1. Considering 
time-multiplexing in OTN-BR as described before, we have 



^Rc,s < max min YVs,{s}, Yr,s\Q) , 

5^ A,/ (X,; F^,|,}|g) + ( 1 - ^A, j / (X,; F^.hIQ) : \/A C V^, S^n = A . 

seF \ ses / ) 

For Gaussian channels, the mutual information terms in ([26]) are maximized when the dis- 
tributions of Xfc, k E {SVJ {r}} are Gaussian. Noting that in the considered settings we have 



max/ (Xfc;FB,|fc|) = - \og^ 
the proof of Proposition |3] is complete. 



1+ E 



p. 



, where i3 C U {r}} and ke{SVJ {r}} [6], 
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Fig. 1. (a) BRC (b) MARC and (c) TN-BR-(2,3). 
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Fig. 2. Nonlinear network codes for an OTN-BR with = 2 and SNR_„ = lOdB, (a) using DNNC-C4 and (b) structured 
network coding. 
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Fig. 3. Performance of the proposed DNNC and DLNC for an OMC-BR with two sources, Rr = R = 3, SNR,r = lOdB and 
SNR,i = -3dB. 
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Fig. 4. Performance of the proposed DNNC and DLNC for an OMARC with two sources, Rr ^ R = 3, SNR,r = lOdB and 
SNR,i = -3dB. 



DNNC-C3 SNR"^""" = IdB (BER = 0.0565) 
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Fig. 5. Performance of the proposed DNNC and DLNC for an OMARC with two sources, Rr = R = ?>, SNR^r = lOdB and 
SNR,j = IdB. 
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SNRri (dB) 



Fig. 6. Performance of the proposed DNNC and DLNC for an OMC-BR with three sources, SNR„ = lOdB and SNR^ = 
-3dB. 




Fig. 7. Average distortion vs. rate for an OMARC with two sources, Rr = R, SNR„ = lOdB and SNRrd = 7dB. 
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Fig. 8. Average distortion vs. rate for an OTN-BR-(2,3) witli Rr = R, SNR,r = lOdB and SWR^ = 7dB. 




SNR,^ (dB) 



Fig. 9. Average distortion vs. source-destination ciiannel SNR for an OTN-BR-(2,3) witli two sources, Rr — R — 3 
SNRsr — lOdB. Performance of linear and proposed structured nonlinear network coding at the relay in comparison with 
performance bound in ([TsJ. 
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